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1 Introduction 


This extended abstract further develops the algorithms in [8] and [9] for 
rewriting expressions involving differential operators. The differential oper- 
ators that we have in mind arise in the local analysis of nonlinear dynamical 
systems. In this work, we extend these algorithms in two different directions: 

1. We generalize the algorithms so that they apply to differential opera- 
tors on groups. This generalization is important for applications. For 
example, the nonlinear system describing a robotic joint or a satellite 
evolves on the group G = 50(3) of spatial rotations. The local study 
of such systems requires the computation of expressions consisting of 
differential operators on G. 

2. We develop the data structures and algorithms to compute symboli- 
cally the action of differential operators on functions. Again, this is 
crucial for applications. We illustrate this by deriving conditions for a 
numerical algorithm to remain constrained to a group. In other words, 
if x n +i = T(x n ) is the update rule for a numerical algorithm evolv- 
ing on a group G, we would like to choose T so that x n £ G implies 

£n+i € G. 

For a further discussion of applications of these algorithms, see [5] and [6] 
and the references given there. 

Here is the 

Set Up. 

1. Let k denote either the real or complex numbers. 

2. Let G denote a finite dimensional Lie group over k, g denote its Lie 
algebra, and Tj, . . Yjy a basis for g of left-invariant vector fields. 

3. Let R = G°°(G) denote the algebra of smooth functions on G taking 
values in k. 

4. Fix M derivations of R of the form 

/ 

N 

f } = !>;%, < e r, j — i, ... , m, in 

V=l 

and let A denote the free associative algebra k<F \ , . . F\{> of dif- 

ferential operators generated by F\, . . ., F\f } with coefficients from 

Jt. 
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We are concerned with the following 

Problem. Given a differential operator p £ A and a function / 6 R, 
substitute the Equations (1) and compute p • / using as few operations as 
possible. This problem is interesting since in many cases cancellations take 
place. 

Example 1. Let G = R /V denote the abelian group, 







the (left invariant) coordinate vector fields, and F \ , F 2 , F 3 three fixed vec- 
tor fields defined in terms of the V' A via Equations (1). Then the naive 
substitution of (1) and simplification of p * /, where 


P = Fa F2 Fi — F'\F\F2 — F\ F2F3 £ A , / £ , 

yields 2 TV 3 terms, while more specialized algorithms need only compute the 
6 jV 3 terms which don't cancel. These types of examples are considered in 
[8] and [9]. 

Example 2. Consider the local analysis of a nonlinear system of the form 
x(l) = F(t(0), x(0) = x° e G, (2) 


In practice, the u ; are constants, functions of time, or perturbation parame- 
ters. The study of this system typically involves the computations of various 
series in the algebra A of differential operators. For example, the local flow 
of the system is determined by the Taylor series 

e X phF = \ + hF+ f ^F 2 + ^F 3 + ...eA[[h}}. 

An alternative to computing higher derivatives F k is to choose constants 
c t * , c l j ) Jfc, j < so that the expression 

exp hcicFk • * ■ exp hc\F \ , 
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where 


.v 

F t = £ € g 

<i=l 

.V 

F 2 = ^ a /1 (exp(/ic 2 iFi) * G g 

/i=i 

:V 

F 3 - E a/1 (exp(/ic 32 F 2 ) • exp(/ic 3l F, ) • x 0 )}^ G g, 

M=l 


is equal to exp/iF to order it. Notice that the left invariant vector fields i\ 
arise by "freezing the coefficients 7 ' of F at various points along its flow. 

Expanding these expressions around the common base point r° G C? 
yields many terms, which must cancel in the end if the algorithm is going 
to approximate the flow of the underlying nonlinear system. The action 
of the differential operators Fj on the coefficient functions a £ must also be 
computed. Notice, that unlike Example 1, the \\ L here do not commute. 
This example will be considered in more detail in Section 4. 

The computations in both examples are easily kept track of by using 
finite rooted trees, labeled with the symbols F \ , . . ., F\f. It turns out the 
the vector space, with basis the set of such trees, has an algebraic structure 
B which is crucial to efficiently organizing the computation. The advantage 
of working with the trees B is that many terms which cancel in the end need 
not be computed. See [6] for an expository treatment of this idea. The key 
observation required for this work is that it is possible to define an action of 
the algebra B of finite rooted trees, labeled with F\, . . F\f, on the ring of 
functions R which enjoys essentially all the properties of the familiar action 
of the algebra /I of differential operators generated by F \ , . . F\i on R. It 
turns out that B is a Hopf algebra, just as A is, and that both actions give 
R the structure of what is called an //-module algebra. 

In Section 2, we review the relevant material from algebra. This material 
may be skimmed on a first reading. In Section 3, we define the Hopf algebra 
of Cayley trees and its action on the ring of functions R. In Section 4, we 
continue the discussion of Example 2. 


4 



2 //-module algebras 

In this section we review the basic facts about bialgebras and //-module 
algebras which will be used in the remainder of this paper. 

In this section, k can be any field of characteristic 0. By an algebra we 
mean a vector space A over the field k with an associative multiplication and 
unit. The multiplication can be represented by a linear map n : A®^A — A; 
the unit can be represented by a linear map k — > ,4 (the map sending 1 £ k 
to 1 £ A). The facts that the multiplication is associative, and that 1 £ A 
is a unit, can be expressed by the commutativity of certain diagrams. For 
example, the commutativity of the diagram 

■ 1 ©* /I ©* A — * A A 

l l 

A A — A 

where the upper horizontal arrow is the map /i® /, the left vertical arrow is 
the map / ® /i, and the remaining two arrows are the map jj, expresses the 
associativity of multiplication. 

The dual notion to an algebra is a coalgebra : a vector space C over the 
field k together with a coassociative coproduct A : C — • ► C®*C and a counit 
e : C — * k. The fact that A is coassociative and that e is a counit is expressed 
by diagrams which are dual to the diagrams which express the facts that the 
multiplication of an algebra is associative, and that 1 £ A is a unit: they are 
the same diagrams, with the direction of all arrows reversed. For example, 
coassociativity is expressed by the commutativity of the diagram 

C ©fc C ®k C * — - C ®k c 

t r 

c® k c < — c 

where the upper horizontal arrow is the map A ® /, the left vertical arrow 
is the map / © A, and the remaining two arrows are the map A. Often the 
element A(c) £ C C is written c (i) ® c (2)- 

/ (c) 

A bialgebra is a vector space H over k which has both an algebra and 
a coalgebra structure, such that the coalgebra structure maps are algebra 
homomorphisms, or equivalently, the algebra structure maps are coalgebra 
homomorphisms. (This equivalence can be seen by expressing the assertion 
that the coalgebra structure maps are algebra homomorphisms as a set of 
commutative diagrams: this set of diagrams is self-dual.) 

Some examples of bialgebras are the following: 
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1. Let G be a group, and let kG be the group algebra of G. the vector 
space kG has the elements of G as a basis, with multiplication defined 
by extending the multiplication on G linearly. The coproduct and 
counit of kG are defined by 

A ! s > = } ,ec. 

<d<7) = 1 J 

2. Let G be an affine algebraic group, and let k[G] be the algebra of 
representative functions on G. The algebra structure of k[G] is the 
usual algebra structure of functions with point-wise multiplications. 
The coproduct arises from the group multiplication G x G — * G, which 
induces the map k[G] — k[G x G] = k[G] ®jt k[G]. The counit arises 
from the map {e } — G % where { c } is the single-element group. 

3. Let L be a Lie algebra over and let U(L) be the universal enveloping 
algebra of L. The coproduct and counit of U(L) are defined by 

A(i) = 1 ® x + i <g> 1 1 

<(*> = 0 / 

and extended to all of U{L) using the fact that A and e are algebra 
homomorphisms. 

Usually, in studying bialgebras, an additional condition is imposed which 
is analogous to the assertion that a semigroup is a group. Such bialgebras are 
called Hopf algebras. The bialgebras which we consider in this paper (such 
as the universal enveloping algebra of a Lie algebra) satisfy this condition 
automatically. 

A coalgebra is said to be cocommutative if it satisfies A = T o A, where 
T is the map T : C C — C ®k C defined by T(x ® y) = y ® x. Note that 
the bialgebras in Examples 1 and 3 are cocommutative. 

A vector space V over k is said to be graded if there is a sequence of 
subspaces Vq, V\, ... such that / 


vz($v n . 

n= 0 

A graded vector space V is said to be connected if Vq = k. 
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Let H be a bialgebra. A II -module algebra is an algebra R which is an 
//-module such that t he action satisfies 

h •(/</) = £(fyi) for all ft (E //, f,g€R. 

(M 

Remark 2.1 If g £ // satisfies A(g) = ® 5 and /? is an //-module algebra, 

then g acts as an endomorphism of /?; if x 6 // satisfies A(x) = l®r + r ® 1 
and /? is an //-module algebra, then x acts as a derivation of R. 

3 //-module algebras and Cayley trees 

In this section we describe a bialgebra structure on the vector space with 
basis all equivalence classes of rooted trees. The relation between trees 
and differential operators goes back at least as far as Cayley [ 3 ] and [\] 
Important use of this relation has been made by Butcher in his work on 
higher order Runge-Kutta algorithms [1] and [ 2 ], In this section and the 
next, we follow the treatment in [8] and [ 9 ]. By a tree we mean a nonempty 
finite rooted tree, and by a forest we mean a finite family of finite rooted 
trees, possibly empty. 

Suppose { F \ t .... F\f } is a set of formal symbols (which later will be the 
names of differential operators). By a labeled tree we mean a tree for which 
we have assigned an element of (Fi, . Fm } to each node, other than 
the root, of the tree. We say that a tree is ordered in case there is a partial 
ordering on the nodes such that the children of each node are non-decreasing 
with respect to the ordering. 

We now describe the bialgebra structure on spaces of trees. Let 

k{T(F x , ...,F m )} 

denote the vector space which has as basis all equivalence classes of labeled, 
ordered trees. The vector space k{T(F x , . . . , F\f)} is graded, with the grad- 
ing given as follows: if the tree t has n + 1 nodes, then 

t£k{f(F x ,...,F M )} n . 

We now define the multiplication on k{T(Fi, Fm)}. Since the set of 
labeled, ordered trees form a basis for k{T(F x , .... F/i/)}, it is sufficient to 
describe the product of two such trees. Suppose that <1 and <2 are labeled, 
ordered trees. Let s, , .... s r be the children of the root of t x . If *2 has n + 1 
nodes (counting the root), there are (n + l) r ways to attach the r subtrees 


7 



of ti which have s\ , . . , s r as roots to the labeled tree t 2 by making each 

s t the child of some node of t 2> keeping all the original labels. Order the 
nodes in the product so that the nodes which originally belonged to each tree 
retain the same relative order to each other, but all the nodes that orginally 
belonged to t\ are greater in the ordering than the nodes that originally 
belonged to t 2 . The product t\t 2 is defined to be the sum of these (n + l) r 
labeled trees. It can be shown that this product is associative, and that the 
trivial labeled tree consisting only of the (unlabeled) root is a right and left 
unit for this product. For details, see [7]. 

We now define the comultiplication on k{T(Fx, . . . , Fm)} If t is a tree 
whose root has children s x , .... s r , the coproduct A (t) is the sum of the 2 r 
terms t\ where the children of the root of and the children of the root 
of t 2 range over all 2 r possible partitions of the children of the root of t into 
two subsets. The labels remain the same, and the ordering is handled in the 
same way as in the product. The map e which sends the trivial labeled tree 
to 1 and every other tree to 0 is a counit for this coproduct. In [7], it is 
shown that these algebra and coalgebra structures are compatible, proving 
the 

Theorem 3.1 The space k{T(F\ , ..., Fm)} is a graded connected cocom - 
mutative bialgebra. 

We call this algebra the algebra of Cayley trees. 

We now define an action of the algebra of Cayley trees 

B = k[T(F u ..., F m )} 

on the ring R , making R a 5-module algebra, which captures the action of 
trees as higher derivations. The action is defined using the map 

V' : fc{T(Fi, , Fm)} — End*. 5, 

as follows: 

1. Given a labeled, ordered tree t with m + 1 nodes, assign the root 
the number 0 and assign the remaining nodes the numbers 1, . . . , m. 
We identify the node with/the number assigned to it. To the node k 
associate the summation index /i*. Denote (m , . . . , /i m ) by /i. 

2. For the labeled tree t, let k be a node of t, labeled with F yk if k > 0, 

and let / /' be the children of k. Define 

R(k\fi) — * * • Yn lt , if k > 0 is not the root; 

— ‘ * i if k = 0 is the root. 
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Note that if k > 0, then R(k\p) g R. 

3. Define 

I v 

0(0 = ^ ■■ ■ R(l;ii)c{Q\fi). 

M 1 f •• i Mm — 1 

4. Extend tp to all of k{T(F\ , . . . , Fm )} by linearity. 

It is straightforward to check that this action of D on R makes R into a 
5-module algebra. 

We summarize with the following theorem. 

Theorem 3.2 Let G denote a finite dimensional Lie group and R the alge- 
bra of smooth functions on G. as detailed in the Set Up. Let D denote the 
algebra of Cayley trees k{T( F\ t F\f)}. Then R is a B-module algebra 
with respect to the action defined by ip. 

Remark 3.1 The standard action of the algebra A of differential operators 
generated by F\ } . . ., F\j on the algebra of smooth functions R gives R the 
structure of a /l-modulc algebra. It is easy to relate these two //-module 
algebra structures on R and this observation is the basis for our algorithms. 
Let 

d> : A — * B 

denote the map sending the generator Fj of the algebra A to the tree con- 
sisting of two nodes: the root and a single child labeled F 3 . Extend <j> to be 
an algebra homomorphism. Let y denote the map 


A — End k R 


defined by using the substitution (1) and simplifying to obtain an endomor- 
phim of R. 

Theorem 3.3 (i) The maps y, <p and if are related by y — 0 0 0- (n) Fix 
a function f £ R and a differential operator p £ A. Then 

t 

P - f = 4>{p) • / 


Here the action on the left views R as an A-module algebra , while the action 
on the right views R as B-module algebra. 
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The first assertion is proved in [9] and the second assertion follows from the 
first assertion and the definitions. 

Using this theorem, it is easy to give an algorithm to solve the Problem 
posed in Section 1. YVe defer to later paper a complete analysis of the 
complexity of the algorithm and simply remark here that in many examples 
the algorithm results in a savings which is exponential in the degree of the 
differential operator. 

Algorithm. Given a smooth function f £ R and a differential operator 
p G A, compute the function p ■ / via • /. 


4 Applications 

YVe use the notation of the Set Up from Section 1. Let cxp(hF)z denote the 
resulting of flowing for time h along the trajectory of the nonlinear svstcm 
(2) through the initial point x° £ G. YVe require a theorem concerned with 
the explicit computation of terms in the Taylor series expansion of a solution 
of (2)* This is one of the main applications of the symbolic calculus described 
in the sections above. 

This theorem is most easily stated if we introduce two additional oper- 
ations on the algebra of Cayley trees B. Given a,0 g B, define the meld 
product (3 © a to be the labeled, ordered tree obtained by identifying the 
roots of the two trees. The meld product is then extended to all of B by 
linearity. Given a derivation F g Der(ft), let 0 be the tree 0 (F) and let 
or e B. Recall 3 is a tree consisting of a root and a node labeled F. We 
define the composition product 3 o a to be the tree formed by attaching the 
subtrees whose roots are the children of the root of or to the node labeled F 
of the tree 0. If a g B is a tree, define the exponential and Meld-exponential 
of a tree by the formal power series 


exp (ha) = l + hct + L- a 2 + ^- a 3 + • • 


Mexp( ha) — l -f- ha 4- — ar © a + © a © a + • • • 

Theorem 4.1 (i ) /Issume / g R and F g Der(fl). Iff is analytic near x, 
then for sufficiently small h, 


f(exp(hF)x) = exp (h<f»(F)) ■ f\ x . 
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(it) Let F = £* =l « M (pxp(/iG)i u )V^, where G € Der(ft), and x° <= G. 
T/ien 

F ■ f = (<p(F) o Mexp(/iG)) • f. 

Using this theorem, it is easy to analyze the numerical algorithm de- 
scribed in Example 2 of Section 1. For typographical reasons, we use the 
following one dimensional notation for trees 1 : the tree consisting of a root 
and a single child labeled F\ is denoted Z[Fj]; the tree consisting of a root 
and two children labeled F\ and F2 is denoted /[Fi,/ 7 ^]; the tree consisting 
of a root, with a single child labeled F\ , which itself has two children labeled 
F2 and F3 is denoted I[F\ [F2 , F3]], etc, Mote that the labels need not be 
distinct, but their order is important. 

Consider the expression 


exp hc^F ; 3 <*xp I1C2F2 exp hc\ F\ 


computed to order IF. Let p G A denote the resulting expression. The 
image <p(p) G B contains the following terms: 


h3c2Ch -l[F[F, F]] + 


2 ! 


H C3C ' U ![F[F, F]] + - ^ /[F[F, F]] 


2! 


2 ! 


+ /> 3 C3C31C 32 /[F[F,F]]. 


Our goal is to choose the constants c, and c l} so that that 


exp hF = p + 0 (h 4 ). 


One of the third order term arising from ©(exp /iF) is ^-/[F, [F, F]]. Setting 
the coefficients of these trees equal to each other yields the constraint: 


c 2 c 21 

2! 


+ 


£ 2 £31 

2 ! 


c z c h . 1 

“ 2 \ *" < - 3 c 3 l c 32 = ^7 


Other constraints arise from the other trees. We have coded this algorithm 
in Maple, Mathematica, and Sn>obol and are currently experimenting with 
it. 

: The notation is due to Peter Olver, as is some of the Mathematica code used to 
generate these examples. 
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